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COPYRIGHT NOTICE 

A portion of the disclosure of this patent document contains material which is 
subject to copyright protection. The copyright owner has no objection to the facsimile 
reproduction of the patent document or the patent disclosure, as it appears in the Patent 
and Trademark Office patent file or records, but otherwise reserves all copyright rights 
whatsoever. 

FIELD OF THE INVENTION 

The present invention relates to the field of browsers for viewing Internet content 
using a palmtop computer or other handheld device. 

BACKGROUND 

As the components required to build a computer system have reduced in size, 
new categories of computer systems have emerged. One of the new categories of 
computer systems is the "palmtop" computer system. A palmtop computer system is a 
computer that is small enough to be held in the hand of a user and can be "palm-sized." 
Such computer systems are implemented as Personal Digital Assistants (PDAs) and 
are finding their way into other hand-held devices such as cellular telephones. 

While these palm sized computers ("palmtop" computers) have dramatically 
reduced size when compared to a desktop or notebook computer, the user would like to 
be able to perform many of the same types of functions performed using physically 
larger and more powerful computers. More recent implementations of such devices 
often have the ability of browsing the Internet using a wireless (or wired) connection. 
Unfortunately, the physical size of the device and it's associated display can seriously 
inhibit the user's browsing experience. 



PALM-3785 US P 



-2- 



Most web pages are designed to display information in a format suitable for 
desktop and notebook computers with display resolutions of, for example, 600 x 800 
pixels. When such pages are displayed on a much smaller display (e.g., a 160 x 160 
pixel display), it is very difficult to effectively view. 
5 This issue has heretofore been addressed in two ways. The first is to use 

horizontal and vertical scrolling of a window over the original web page as illustrated in 
Figure 1 . In this implementation, the user scrolls a window 50 corresponding to the 
screen size of the hand-held device vertically and horizontally to reveal various portions 
of the web page. While this permits the user to access the entire web page, it is 
10 cumbersome to use and often provides an unsatisfying browsing experience, 
jz The second mechanism used to address the problem is by using a proxy server 

O to convert the web page to a format that can be viewed more comfortably by the hand- 
3 held device using a process called "transcoding" to translate the web page code to a 
[V more suitable format for the hand-held device. Unfortunately, using a proxy server has 
1§j several disadvantages. The proxy server must generally be hosted and managed. If 
JU the proxy server is hosted by a carrier, then the browser will not be able to access 
H- intranet web pages behind a corporate firewall. Secure web pages would no longer be 
£ secure, since the proxy server must decrypt the web page prior to transcoding. If the 
5 proxy server is hosted within an enterprise, is must be internally managed within the 

111 

20 enterprise (e.g., by the corporate Information Technology department). Also, the use of 
a proxy server can slow access to web pages under many circumstances. 

SUMMARY OF THE INVENTION 

Accordingly, what is needed is a mechanism for viewing web pages using a 
25 handheld device that does not require a proxy server and minimizes need for both 
horizontal and vertical scrolling. 

A hand-held computer device consistent with certain embodiments of the present 
invention incorporates integral web page transcoding. A processor, forming a part of 
the handheld computer has a display coupled to the processor forming a part of the 
30 handheld computer, with the display having limited resolution of MxN pixels. A browser 
program running on the processor facilitates retrieving and viewing of a web page 
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having size greater than MxN on the display. This is accomplished in a browser having 
an associated browser plug-in that transcodes the web page to a format adapted to the 
display. The transcoding is carried out by generating a menu of frames from the web 
page to permit a user to select a desired frame for display by selecting frame titles as 

5 menu selections; compressing an image to a size suitable for display on the MxN 

resolution display, wherein the image has size and pixel depth, by reducing the image's 
size and reducing the image's pixel depth; and converting multiple columns into a single 
column for display on the MxN resolution display by removing redundant table definition 
tags. This provides advantages of eliminating the need for a proxy server to produce 

1 0 web pages more suitable for display on the limited resolution display of the hand-held 
J? device. 

5 A hand-held computer device consistent with certain embodiments of the present 

3 invention has a processor, forming a part of the handheld computer. A display is 

coupled to the processor forming a part of the handheld computer, the display having 
15J resolution of MxN pixels. A browser program runs on the processor to facilitate 
U retrieving and viewing of a web page on the display, the web page having a size greater 
H than MxN. The browser has an associated program code for transcoding the web page 
j; to a format adapted to the display. 

5 A method of transcoding a web page within a hand-held computer device with 

20 display having resolution of MxN, consistent with certain embodiments of the present 
invention, includes determining if the web page contains multiple frames, and if so 
generating a menu of frames from the web page to permit a user to select a desired 
frame for display; determining if the web page contains any images, and if so 
compressing the images to a size suitable for display on the MxN resolution display; 

25 and determining if the web page contains multiple columns, and if so converting the 
multiple columns into a single column for display on the MxN resolution display. 

A method of transcoding a web page within a hand-held computer device with 
display having resolution of MxN, consistent with certain embodiments of the present 
invention, includes determining if the web page contains multiple frames; and 

30 if the web page contains multiple frames, generating a menu of frames from the 

web page to permit a user to select a desired frame for display. 
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A method of transcoding a web page within a hand-held computer device with 
display having resolution of MxN, consistent with certain embodiments of the present 
invention, includes determining if the web page contains an image; and if the web page 
contains an image, compressing the image to a size suitable for display on the MxN 

5 resolution display. 

A method of transcoding a web page within a hand-held computer device with 
display having resolution of MxN, consistent with certain embodiments of the present 
invention, includes determining if the web page contains multiple columns; and if the 
web page contains multiple columns, converting the multiple columns into a single 
1 0 column for display on the MxN resolution display. 
u Any of the above methods can be implemented as instructions stored on an 

2 electronic storage medium so that the method is carried out when the instructions are 
J executed on a programmed processor forming a part of a hand-held computer, 
m The above summaries are intended to illustrate exemplary embodiments of the 

1|S invention, which will be best understood in conjunction with the detailed description to 

Lii 

J follow, and are not intended to limit the scope of the appended claims. 
0 BRIEF DESCRIPTION OF THE DRAWINGS 

2W Figure 1 illustrates a method of viewing a web page using horizontal and vertical 

scrolling. 

Figure 2 is a logical block diagram of the palmtop computer system which is 
suitable for use in implementing certain embodiments of the present invention. 

Figure 3 is a flow chart describing the high level operation of an embodiment of 
25 the present invention. 

Figure 4 is a flow chart describing a more detailed process for transcoding 
according to certain embodiments of the present invention. 

Figure 5 shows an exemplary web page with three columns. 

Figure 6 shows the exemplary web page of Figure 5 after the columns are 
30 converted to a single column. 

Figure 7 shows an exemplary web page image. 
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Figure 8 shows the exemplary web page image of Figure 7 after the image has 
been size reduced. 

DETAILED DESCRIPTION OF THE INVENTION 

5 In the following detailed description of the present invention, numerous specific 

details are set forth in order to provide a thorough understanding of the present 
invention. However, it will be recognized by one skilled in the art that the present 
invention may be practiced without these specific details or with equivalents thereof. In 
other instances, well known methods, procedures, components, and circuits have not 

1 0 been described in detail as not to unnecessarily obscure aspects of the present 
U invention. 

J NOTATION AND NOMENCLATURE 

m Some portions of the detailed descriptions which follow are presented in terms of 

1p™ procedures, steps, logic blocks, processing, and other symbolic representations of 
r operations on data bits that can be performed on computer memory. These 
rf descriptions and representations are the means used by those skilled in the data 
^ processing arts to most effectively convey the substance of their work to others skilled 
5 in the art. A procedure, computer executed step, logic block, process, etc., is here, and 
2tf generally, conceived to be a self-consistent sequence of steps or instructions leading to 
a desired result. The steps are those requiring physical manipulations of physical 
quantities. 

Usually, though not necessarily, these quantities take the form of electrical or 
magnetic signals capable of being stored, transferred, combined, compared, and 
25 otherwise manipulated in a computer system. It has proven convenient at times, 
principally for reasons of common usage, to refer to these signals as bits, values, 
elements, symbols, characters, terms, numbers, or the like. 

It should be borne in mind, however, that all of these and similar terms are to be 
associated with the appropriate physical quantities and are merely convenient labels 
30 applied to these quantities. Unless specifically stated otherwise as apparent from the 
following discussions, it is appreciated that throughout the present invention, 
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discussions utilizing terms such as "processing" or "generating" or "converting" or 
"compressing" or "determining" or "removing" or "displaying" or "recognizing" or the like, 
refer to the action and processes of a computer system, or similar electronic computing 
device, that manipulates and transforms data represented as physical (electronic) 
5 quantities within the computer system's registers and memories into other data similarly 
represented as physical quantities within the computer system memories or registers or 
other such information storage, transmission or display devices. 

HAND-HELD BROWSER TRANSCODING IN ACCORDANCE WITH THE PRESENT 
10 INVENTION 

55 While this invention is susceptible of embodiment in many different forms, there 

O is shown in the drawings and will herein be described in detail specific embodiments, 
sj with the understanding that the present disclosure is to be considered as an example of 
2 the principles of the invention and not intended to limit the invention to the specific 
15J embodiments shown and described. In the description below, like reference numerals 
r% are used to describe the same, similar or corresponding parts in the several views of the 
drawings. 

M Figure 2 illustrates circuitry of computer system 1 00, some of which can be 

H implemented within the handheld device of the present invention. Examples of such 

20 hand-held devices are commercially available from Palm Computing, Inc., 5470 Great 
America Parkway, Santa Clara, CA 95054. Computer system 100 includes an 
address/data bus 1 10 for communicating information, a central processor 101 coupled 
with the bus for processing information and instructions, a volatile memory 102 (e.g., 
random access memory RAM) coupled with the bus 1 10 for storing information and 

25 instructions for the central processor 101 and a non-volatile memory 1 03 (e.g., read 
only memory ROM) coupled with the bus 110 for storing static information and 
instructions for the processor 101 . Computer system 100 also includes an optional data 
storage device 104 (e.g., memory stick, SD memory, etc.) coupled with the bus 100 for 
storing information and instructions. Device 104 can be removable. As described 

30 above, system 1 00 also contains a display device 1 05 coupled to the bus 1 1 0 for 
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displaying information to the computer user. The display device 105 is generally of 
limited resolution of MxN pixels - limited primarily by the size of the hand-held device. 

Also included in computer system 100 of Figure 2 is an optional alphanumeric 
input device 106 which in one implementation is a handwriting recognition pad 
5 ("digitizer") having regions 106a and 106b (Figure 2A), for instance. Device 106 can 
communicate information and command selections to the central processor 101. 
System 110 also includes an optional cursor control or directing device 107 coupled to 
the bus for communicating user input information and command selections to the 
central processor 101. In one implementation, device 107 is a touch screen device 
10 incorporated with screen 105. Device 107 is capable of registering a position on the 
E screen 1 05 where the stylus makes contact. The display device 1 05 utilized with the 
O computer system 110 may be a liquid crystal device, cathode ray tube (CRT), field 
Sj emission device (FED, also called flat panel CRT) or other display device suitable for 
E creating graphic images and alphanumeric characters recognizable to the user. In the 
W preferred embodiment, display 1 05 is a flat panel display. 
h Signal communication device 1 08, also coupled to bus 1 1 0 in the illustrated 

h embodiment, can be a serial port for communicating with a host computer through a 
JE cradle. Device 108 can also include an infrared communication port. Browser software 
S or firmware can be stored in ROM 1 03 and/or RAM 1 02 and/or data storage device 1 04 
20 along with so called "plug-ins". 

Referring now to Figure 3, a process 200 is illustrated, in accordance with certain 
embodiments of the present invention, in which a transcoding operation is carried out 
within the hand-held device (e.g. palmtop computer) upon receipt of a web page, 
without use of a proxy server (i.e., the process is proxyless). The web page, in certain 
25 embodiments can be received via a wireless connection to the Internet such as a 
wireless IEEE 802.1 1 compliant (or similar) connection which may be within an 
enterprise's firewall. 

The process starts at 204, after which a web page is specified by the user at 210, 
for example, by entering the page's URL (Universal Resource Locator) or by selecting a 
30 link from another web page, document or email. The hand-held device's browser then 
retrieves the associated page via the connection to the Internet and passes the page to 
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the transcoder plug-in associated with the Browser at 222 (or equivalent^, passes a 
pointer to a memory location or a file name of a file storing the page to the plug in). The 
transcoder plug-in then transcodes to web page to produce a more readily viewable 
page at 228 and the transcoded page is then displayed on the hand-held device's 
5 display at 234. 

The transcoding process of certain embodiments of the invention is described in 
greater detail hereinafter starting at Figure 4. Figure 4 shows an illustrative process 228 
for transcoding the web page starting at 300. Most web pages have one or more of 
three elements that are addressed by the transcoder process 228 - - frames, tables, and 
1 0 images. When the web page is received at 304, it is passed to 31 0 to determine if there 
are multiple frames in the web page. If so, the user is given the opportunity to select a 
O frame from among the frames making up the web page. This is accomplished in this 
5 embodiment by extracting the frame titles from the web page code at 314 and using 

asp. 

these titles as items that can be selected by the user from a menu generated at 318. 
1 When the user makes selection of one of the available frames at 322, the selected 
m frame corresponding to the user selection is taken for further processing at 328. Thus, 
p multiple frames are dealt with by giving the user the opportunity to select among the 

£ iii r. i 

U various available frames for display. 

£ The transcoding process proceeds at 334 if there are not multiple frames at 31 0 

2GJ or if the user selects a frame at 322. At 334, table definitions are addressed. Multiple 
table definition statements within the web page are often used to create multiple 
columns in a web page. However, multiple columns can be troublesome to view on the 
small MxN pixel display of a hand-held computer device. So, the approach taken in this 
embodiment is to convert multiple columns into a single column format that can simply 
25 be scrolled through vertically, thus eliminating need for horizontal scrolling for the 
purpose of accessing multiple columns. This is accomplished in this embodiment by 
identifying table definition statements and deleting all table definitions except the first 
one. This effectively converts an arrangement of horizontally stacked columns into a 
single column with the original second column following the first vertically (and so on). 
30 Table definitions in HTML (Hypertext Markup Language) and similar languages 

are created using table definition tages <TD> and </TD>. Removing multiple <TD> and 



PALM-3785 US P 



-9- 



</TD> table cell tags in HTML source code requires very little processing power to 
search and remove redundant table cell tags within a single table row pairing <TR> 
</TR>. The example of Listing 1 below illustrates the process. 

Figure 5 shows an original web page 402 extracted from the Yahoo™ online web 
5 site (www.yahoo.com). Listing 1 shows the HTML source code (Copyright Yahoo) used 
to implement the original web page. In order to reformat the page, the browser 
examines the HTML code and removes the excess <TD> and <TD> tags (all except the 
first) as shown in strikethrough in Listing 1 . The resulting HTML code would be identical 
to that of Listing 1 with the portions shown in strikethrough eliminated. With excess 
1 0 table cell tags removed, the web page would be rendered in a single column shown as 
E 406 in Figure 6 (on a conventional computer display). When rendered on a hand-held 
□ display, horizontal scrolling for the purpose of accessing multiple columns is eliminated. 

m Listing 1 

151 — — 

l.i <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> 

"7 <HTML> 
p <BODY> 

jp <TABLE border=0 cellSpacing=0 width="100%"> 
2Qk <TBODY> 
£ <TR> 

Q <TD vAlign=top width="30% "XSMALLXB>Departments</BXBR> • <A 

ry href ="http: //www. yahoo. cora/s/1021">Apparel</AXBR>- <A 

href="http: //www. yahoo. cora/s/1023">Computers</AXBR> • <A 
25 href="http: //www. yahoo. com/s/1059">DVDs</AXBR>- <A 

href="http: //www. yahoo. com/s/2509">Electronics</AXBR> • <A 
href="http: //www. yahoo. com/s/2510">Flowers</AXBR>- <A 
href ="http : / /www . yahoo . com/s/27 69 "> Jewelry</AXBR> • <A 
href="http: //www. yahoo, com/s/27 70">Sports</AXBR>- <A 
30 href="http: //www. yahoo. com/s/2511">Toys</AXBR>- <A 

href="http: //www. yahoo. com/s/2512">Video Games < /AXBR> • <A 
href="http: //www. yahoo . com/ s/ 1020 ">more 
deptS . </AXBRX/SMALLX-/¥£» 

<TD vAlign-top width-"30°o"X SMALLXB>Stores</BXBR>- <A 

35 href="http: //www. yahoo. com/s/1194">Eddie Bauer</AXBR> • <A 

hr ef = "ht tp : / /www . yahoo . com/ s / 1 1 9 5 " >Gap< /AXBR> • <A 
href="http: //www. yahoo. com/s/1196">Barnes & 

Noble</AXBR>- <A 

href="http: //www. yahoo. com/s/1197">Victoria ' s 
40 Secret</AXBR>- <A 
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href="http: //www. yahoo. com/s/1062">more 
stores</AXBRX/SMALL> </TD> 

-TP -.'Align-t T F ^ feh=^^% JL > <SMALLXB>Features</BXBR>- <A 
href="http: //www. yahoo. com/s/2793">Holiday Gif ts</AXBR> • 

<A 

href="http: //www. yahoo. com/s/1356">Harry Potter</AXBR>- 
hre f ="http : / /www . yahoo . com/ s / 2 7 3 0 " >Xbox Exclus ive</AXBR> • 
href="http: //www. yahoo. com/s/2794">Free Shipping</AXBR>- 

<A 

href="http: //www. yahoo. com/s/2775">Toys by 
Age< /AXBRX / SMALL> 
</TD> 
</TR> 
</TB0DY> 
</TABLE> 
</B0DY> 
</HTML> 



Returning to Figure 4, the final issue that is addressed is that of images. Images 
provided on web pages often have more information than can reasonably be displayed 
on the limited resolution MxN pixel display of the hand-held device. Accordingly, the 
approach taken in this embodiment to address the problems of images is to reduce the 
size and pixel depth of the images. This is done by first finding an image tag at 340. (If 
none is found, processing is unnecessary as indicated.) For each image tag found, the 
image is retrieved and processed by reducing the image's size at 346 to a size that can 
be displayed in the MxN pixel display and reducing the image's pixel depth (e.g., by 
compressing the image's gray scale and/or reducing the number of colors) at 350. 

Other arrangements for reducing the image size for display on a smaller display 
are known and can be used in conjunction with the present invention. The most 
common image formats used in web pages are GIF and JPG. These image formats 
support easy reduction using the relatively small computing horsepower available in the 
handheld. Many handheld applications such as those described above are already 
available which reduce images. For example, the image processing can be carried out 
using algorithms used in the commercially available IA Album™ product available from 
IA Style, Inc. or MGI Photosuite™ available from MGI Software Corp. or DreamHouse 
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PocketPhoto™ available from Dreamhouse Software, Inc. When the last image is 
processed, the plug-in returns the transcoded web page (or a pointer thereto) for 
display. 

As described, Images embedded in web pages should be scaled down for 

5 viewing on the handheld. When using a proxy-assisted browser, image reduction of 
both size and pixel depth is typically performed on the proxy server prior to delivery to 
the handheld. But in the current proxyless environment, the handheld device 
implements the image reduction process. In the embodiment described herein, a plugin 
architecture is used in the handheld device's browser so that image manipulation 

10 applications can be registered and leveraged. The plugin is a standalone application 
u that receives a file pointer as input and returns a file pointer back to the browser. 
2 When a web page contains an image, the browser saves that image to a file and 

4- passes the file pointer to the plugin. The plugin reduces the image, saves the result into 
n] a new file, and passes a new file pointer back to the browser. The browser references 
iS the new file pointer when displaying the image. 

The following example illustrates the process. A web page containing an image 
i of a zebra is referenced with an HTML <img src=. . . > tag. Figure 7 shows the web page 
420 and Listing 2 shows the HTML source code used to create it. The handheld 

6 browser, upon receiving the <img src=. . . > tag first extracts the image to a local file, as 
2tf shown as pseudocode in Listing 3. In this example, the local file is named 

"C: \temp\transcodeOnPalmPatent\10922944 . jpg". The browser passes a 
pointer to this file to the image processing plugin, which reduces and stores the image 
to a new file named 

"C:\temp\transcodeOnPalmPatent\reduced\10922944.jpg", and returns this 
25 file pointer back to the browser. Listing 4 shows that the browser references the newly 
reduced file in the HTML <img src=...> tag and Figure 8 shows the resulting rendered 
web page 426 with a reduced image. 

Listing 2 

^ _ — — 

<html><head><title>Yahoo! Picture Gallery</title></head> 
<body bgcolor="#ffffff"> 
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<img src=" http://gallery.yimg.eom/c/256wm/10922944.jpg" 

width=170 height=256 border=l><br> 
<font size="+l"Xb>Zebra </bx/font><br> 

< /body></html> 

5 

Listing 3 

ORIGINAL IMAGE AT: 
10 http://gallery.yimg.eom/c/256wm/10922944.jpg 

BROWSER EXTRACTS TO: C:\temp\transcodeOnPalmPatent\10922944.jpg 
U BROWSER PASSES FILE POINTER TO IMAGE PROCESSING APPLICATION 
§ IMAGE PROCESSING APP REDUCES FILE, STORES TO: 
J c: \temp\transcodeOnPalmPatent\reduced\10922944 . jpg 

1 j! I MAGE PROCESSING APP NEW FILE POINTER TO BROWSER 

us 

U Listing 4 

2tt <htmlxhead><title>Yahoo! Picture Gallery</titleX/head> 
O <body bgcolor="#ffffff"> 

r ~ <img src=" C:\temp\transcodeOnPalmPatent\reduced\10922944.jpg" 
width=85 height=128 border=l><br> 
<font size="+l"xb>Zebra </bx/f ontxbr> 
25 </bodyX/html> 



Those skilled in the art will appreciate that the order of the operations described 
above can be modified and the processing of images and tables can be carried out in 
30 any order or simultaneously within the scope of this embodiment of the invention. Also, 
although the examples shown are illustrated using HTML coding, this should not be 
considered limiting since similar equivalent processes can be devised to handle other 
languages including, but not limited to XML and Java, without departing from the 
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present invention. Moreover, although the present invention is described as a plug-in 
for browser software, other implementations are possible including incorporation within 
the browser software. 

Those skilled in the art will recognize that the present invention has been 
5 described in terms of exemplary embodiments based upon use of a programmed 

processor. However, the invention should not be so limited, since the present invention 
could be implemented using hardware component equivalents such as special purpose 
hardware and/or dedicated processors which are equivalents to the invention as 
described and claimed. Similarly, general purpose computers, microprocessor based 
10 computers, micro-controllers, optical computers, analog computers, dedicated 
;5 processors and/or dedicated hard wired logic may be used to construct alternative 
O equivalent embodiments of the present invention. 

The present invention is preferably implemented using a programmed processor 
such as processor 101 executing programming instructions that are broadly described 
fj§ above in flow chart form and can be stored on any suitable electronic storage medium, 
n However, those skilled in the art will appreciate that the processes described above can 
\r be implemented in any number of variations and in many suitable programming 
£ languages without departing from the present invention. For example, the order of 
H certain operations carried out can often be varied, and additional operations can be 
20 added without departing from the invention. Error trapping can be added and/or 
enhanced and variations can be made in user interface and information presentation 
without departing from the present invention. Such variations are contemplated and 
considered equivalent. 

While the invention has been described in conjunction with specific 
25 embodiments, it is evident that many alternatives, modifications, permutations and 
variations will become apparent to those skilled in the art in light of the foregoing 
description. Accordingly, it is intended that the present invention embrace all such 
alternatives, modifications and variations as fall within the scope of the appended 
claims. 
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